Making remote measurement technology work in multiple sclerosis, epilepsy and depression: survey of healthcare professionals

BACKGROUND: Epilepsy, multiple sclerosis(MS) and depression are long term, central nervous system disorders which have a significant impact on everyday life. Evaluating symptoms of these conditions is problematic and typically involves repeated visits to a clinic. Remote measurement technology (RMT), consisting of smartphone apps and wearables, may offer a way to improve upon existing methods of managing these conditions. The present study aimed to establish the practical requirements that would enable clinical integration of data from patients' RMT, according to healthcare professionals. METHODS: This paper reports findings from an online survey of 1006 healthcare professionals currently working in the care of people with epilepsy, MS or depression. The survey included questions on types of data considered useful, how often data should be collected, the value of RMT data, preferred methods of accessing the data, benefits and challenges to RMT implementation, impact of RMT data on clinical practice, and requirement for technical support. The survey was presented on the JISC online surveys platform. RESULTS: Among this sample of 1006 healthcare professionals, respondents were positive about the benefits of RMT, with 73.2% indicating their service would be likely or highly likely to benefit from the implementation of RMT in patient care plans. The data from patients' RMT devices should be made available to all nursing andmedical team members and could be reviewed between consultations where flagged by the system. However, results suggest it is also likely that RMT data would be reviewed in preparation for and during a consultation with a patient. Time to review information is likely to be one ofthe greatest barriers to successful implementation of RMT in clinical practice. CONCLUSIONS: While further work would be required to quantify the benefits of RMT in clinical practice, the findings from this survey suggest that a wide array of clinical team members treating epilepsy, MS and depression would find benefit from RMT data in the care of their patients. Findings presented could inform the implementation of RMT and other digital interventions in the clinical management of a range of neurological and mental health conditions

The impact of data from remote measurement technology on the clinical practice of healthcare professionals in depression, epilepsy and multiple sclerosis: survey

BackgroundA variety of smartphone apps and wearables are available both to help patients monitor their health and to support health care professionals (HCPs) in providing clinical care. As part of the RADAR-CNS consortium, we have conducted research into the application of wearables and smartphone apps in the care of people with multiple sclerosis, epilepsy, or depression.MethodsWe conducted a large online survey study to explore the experiences of HCPs working with patients who have one or more of these conditions. The survey covered smartphone apps and wearables used by clinicians and their patients, and how data from these technologies impacted on the respondents' clinical practice. The survey was conducted between February 2019 and March 2020 via a web-based platform. Detailed statistical analysis was performed on the answers.ResultsOf 1009 survey responses from HCPs, 1006 were included in the analysis after data cleaning. Smartphone apps are used by more than half of responding HCPs and more than three quarters of their patients use smartphone apps or wearable devices for health-related purposes. HCPs widely believe the data that patients collect using these devices impacts their clinical practice. Subgroup analyses show that views on the impact of this data on different aspects of clinical work varies according to whether respondents use apps themselves, and, to a lesser extent, according to their clinical setting and job role.ConclusionsUse of smartphone apps is widespread among HCPs participating in this large European survey and caring for people with epilepsy, multiple sclerosis and depression. The majority of respondents indicate that they treat patients who use wearables and other devices for health-related purposes and that data from these devices has an impact on clinical practice

RADAR-Base: Open Source Mobile Health Platform for Collecting, Monitoring, and Analyzing Data Using Sensors, Wearables, and Mobile Devices

BACKGROUND: With a wide range of use cases in both research and clinical domains, collecting continuous mobile health (mHealth) streaming data from multiple sources in a secure, highly scalable, and extensible platform is of high interest to the open source mHealth community. The European Union Innovative Medicines Initiative Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) program is an exemplary project with the requirements to support the collection of high-resolution data at scale; as such, the Remote Assessment of Disease and Relapse (RADAR)-base platform is designed to meet these needs and additionally facilitate a new generation of mHealth projects in this nascent field. // OBJECTIVE: Wide-bandwidth networks, smartphone penetrance, and wearable sensors offer new possibilities for collecting near-real-time high-resolution datasets from large numbers of participants. The aim of this study was to build a platform that would cater for large-scale data collection for remote monitoring initiatives. Key criteria are around scalability, extensibility, security, and privacy. // METHODS: RADAR-base is developed as a modular application; the backend is built on a backbone of the highly successful Confluent/Apache Kafka framework for streaming data. To facilitate scaling and ease of deployment, we use Docker containers to package the components of the platform. RADAR-base provides 2 main mobile apps for data collection, a Passive App and an Active App. Other third-Party Apps and sensors are easily integrated into the platform. Management user interfaces to support data collection and enrolment are also provided. // RESULTS: General principles of the platform components and design of RADAR-base are presented here, with examples of the types of data currently being collected from devices used in RADAR-CNS projects: Multiple Sclerosis, Epilepsy, and Depression cohorts. // CONCLUSIONS: RADAR-base is a fully functional, remote data collection platform built around Confluent/Apache Kafka and provides off-the-shelf components for projects interested in collecting mHealth datasets at scale

Automatic Assessment of the 2-Minute Walk Distance for Remote Monitoring of People with Multiple Sclerosis

The aim of this study was to investigate the feasibility of automatically assessing the 2-Minute Walk Distance (2MWD) for monitoring people with multiple sclerosis (pwMS). For 154 pwMS, MS-related clinical outcomes as well as the 2MWDs as evaluated by clinicians and derived from accelerometer data were collected from a total of 323 periodic clinical visits. Accelerometer data from a wearable device during 100 home-based 2MWD assessments were also acquired. The error in estimating the 2MWD was validated for walk tests performed at hospital, and then the correlation (r) between clinical outcomes and home-based 2MWD assessments was evaluated. Robust performance in estimating the 2MWD from the wearable device was obtained, yielding an error of less than 10% in about two-thirds of clinical visits. Correlation analysis showed that there is a strong association between the actual and the estimated 2MWD obtained either at hospital (r = 0.71) or at home (r = 0.58). Furthermore, the estimated 2MWD exhibits moderate-to-strong correlation with various MS-related clinical outcomes, including disability and fatigue severity scores. Automatic assessment of the 2MWD in pwMS is feasible with the usage of a consumer-friendly wearable device in clinical and non-clinical settings. Wearable devices can also enhance the assessment of MS-related clinical outcomes

Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol

BACKGROUND: There is a growing body of literature highlighting the role that wearable and mobile remote measurement technology (RMT) can play in measuring symptoms of major depressive disorder (MDD). Outcomes assessment typically relies on self-report, which can be biased by dysfunctional perceptions and current symptom severity. Predictors of depressive relapse include disrupted sleep, reduced sociability, physical activity, changes in mood, prosody and cognitive function, which are all amenable to measurement via RMT. This study aims to: 1) determine the usability, feasibility and acceptability of RMT; 2) improve and refine clinical outcome measurement using RMT to identify current clinical state; 3) determine whether RMT can provide information predictive of depressive relapse and other critical outcomes. METHODS: RADAR-MDD is a multi-site prospective cohort study, aiming to recruit 600 participants with a history of depressive disorder across three sites: London, Amsterdam and Barcelona. Participants will be asked to wear a wrist-worn activity tracker and download several apps onto their smartphones. These apps will be used to either collect data passively from existing smartphone sensors, or to deliver questionnaires, cognitive tasks, and speech assessments. The wearable device, smartphone sensors and questionnaires will collect data for up to 2-years about participants' sleep, physical activity, stress, mood, sociability, speech patterns, and cognitive function. The primary outcome of interest is MDD relapse, defined via the Inventory of Depressive Symptomatology- Self-Report questionnaire (IDS-SR) and the World Health Organisation's self-reported Composite International Diagnostic Interview (CIDI-SF). DISCUSSION: This study aims to provide insight into the early predictors of major depressive relapse, measured unobtrusively via RMT. If found to be acceptable to patients and other key stakeholders and able to provide clinically useful information predictive of future deterioration, RMT has potential to change the way in which depression and other long-term conditions are measured and managed. KEYWORDS: M-health; Major depressive disorder; Observational cohort; Outcome measurement; Passive sensing; Prospective study; Remote measurement technolog

The utility of wearable devices in assessing ambulatory impairments of people with multiple sclerosis in free-living conditions

Background and objectives Multiple sclerosis (MS) is a progressive inflammatory and neurodegenerative disease of the central nervous system affecting over 2.5 million people globally. In-clinic six-minute walk test (6MWT) is a widely used objective measure to evaluate the progression of MS. Yet, it has limitations such as the need for a clinical visit and a proper walkway. The widespread use of wearable devices capable of depicting patients’ activity profiles has the potential to assess the level of MS-induced disability in free-living conditions. Methods In this work, we extracted 96 features in different temporal granularities (from minute-level to day-level) from wearable data and explored their utility in estimating 6MWT scores in a European (Italy, Spain, and Denmark) MS cohort of 337 participants over an average of 10 months’ duration. We combined these features with participants’ demographics using three regression models including elastic net, gradient boosted trees and random forest. In addition, we quantified the individual feature's contribution using feature importance in these regression models, linear mixed-effects models, generalized estimating equations, and correlation-based feature selection (CFS). Results The results showed promising estimation performance with R2 of 0.30, which was derived using random forest after CFS. This model was able to distinguish the participants with low disability from those with high disability. Furthermore, we observed that the minute-level (≤ 8 minutes) step count, particularly those capturing the upper end of the step count distribution, had a stronger association with 6MWT. The use of a walking aid was indicative of ambulatory function measured through 6MWT. Conclusions This study demonstrates the utility of wearables devices in assessing ambulatory impairments in people with MS in free-living conditions and provides a basis for future investigation into the clinical relevance

Identifying depression-related topics in smartphone-collected free-response speech recordings using an automatic speech recognition system and a deep learning topic model

Language use has been shown to correlate with depression, but large-scale validation is needed. Traditional methods like clinic studies are expensive. So, natural language processing has been employed on social media to predict depression, but limitations remain-lack of validated labels, biased user samples, and no context. Our study identified 29 topics in 3919 smartphone-collected speech recordings from 265 participants using the Whisper tool and BERTopic model. Six topics with a median PHQ-8 greater than or equal to 10 were regarded as risk topics for depression: No Expectations, Sleep, Mental Therapy, Haircut, Studying, and Coursework. To elucidate the topic emergence and associations with depression, we compared behavioral (from wearables) and linguistic characteristics across identified topics. The correlation between topic shifts and changes in depression severity over time was also investigated, indicating the importance of longitudinally monitoring language use. We also tested the BERTopic model on a similar smaller dataset (356 speech recordings from 57 participants), obtaining some consistent results. In summary, our findings demonstrate specific speech topics may indicate depression severity. The presented data-driven workflow provides a practical approach to collecting and analyzing large-scale speech data from real-world settings for digital health research

Multilingual markers of depression in remotely collected speech samples: A preliminary analysis

Background: Speech contains neuromuscular, physiological and cognitive components, and so is a potential biomarker of mental disorders. Previous studies indicate that speaking rate and pausing are associated with major depressive disorder (MDD). However, results are inconclusive as many studies are small and underpowered and do not include clinical samples. These studies have also been unilingual and use speech collected in controlled settings. If speech markers are to help understand the onset and progress of MDD, we need to uncover markers that are robust to language and establish the strength of associations in real-world data. // Methods: We collected speech data in 585 participants with a history of MDD in the United Kingdom, Spain, and Netherlands as part of the RADAR-MDD study. Participants recorded their speech via smartphones every two weeks for 18 months. Linear mixed models were used to estimate the strength of specific markers of depression from a set of 28 speech features. // Results: Increased depressive symptoms were associated with speech rate, articulation rate and intensity of speech elicited from a scripted task. These features had consistently stronger effect sizes than pauses. // Limitations: Our findings are derived at the cohort level so may have limited impact on identifying intra-individual speech changes associated with changes in symptom severity. The analysis of features averaged over the entire recording may have underestimated the importance of some features. // Conclusions: Participants with more severe depressive symptoms spoke more slowly and quietly. Our findings are from a real-world, multilingual, clinical dataset so represent a step-change in the usefulness of speech as a digital phenotype of MDD

Long-term participant retention and engagement patterns in an app and wearable-based multinational remote digital depression study

Recent growth in digital technologies has enabled the recruitment and monitoring of large and diverse populations in remote health studies. However, the generalizability of inference drawn from remotely collected health data could be severely impacted by uneven participant engagement and attrition over the course of the study. We report findings on long-term participant retention and engagement patterns in a large multinational observational digital study for depression containing active (surveys) and passive sensor data collected via Android smartphones, and Fitbit devices from 614 participants for up to 2 years. Majority of participants (67.6%) continued to remain engaged in the study after 43 weeks. Unsupervised clustering of participants' study apps and Fitbit usage data showed 3 distinct engagement subgroups for each data stream. We found: (i) the least engaged group had the highest depression severity (4 PHQ8 points higher) across all data streams; (ii) the least engaged group (completed 4 bi-weekly surveys) took significantly longer to respond to survey notifications (3.8 h more) and were 5 years younger compared to the most engaged group (completed 20 bi-weekly surveys); and (iii) a considerable proportion (44.6%) of the participants who stopped completing surveys after 8 weeks continued to share passive Fitbit data for significantly longer (average 42 weeks). Additionally, multivariate survival models showed participants' age, ownership and brand of smartphones, and recruitment sites to be associated with retention in the study. Together these findings could inform the design of future digital health studies to enable equitable and balanced data collection from diverse populations

Longitudinal Relationships Between Depressive Symptom Severity and Phone-Measured Mobility: Dynamic Structural Equation Modeling Study

Methods Results Discussion References Abbreviations Copyright Abstract Background: The mobility of an individual measured by phone-collected location data has been found to be associated with depression; however, the longitudinal relationships (the temporal direction of relationships) between depressive symptom severity and phone-measured mobility have yet to be fully explored. Objective: We aimed to explore the relationships and the direction of the relationships between depressive symptom severity and phone-measured mobility over time. Methods: Data used in this paper came from a major EU program, called the Remote Assessment of Disease and Relapse–Major Depressive Disorder, which was conducted in 3 European countries. Depressive symptom severity was measured with the 8-item Patient Health Questionnaire (PHQ-8) through mobile phones every 2 weeks. Participants’ location data were recorded by GPS and network sensors in mobile phones every 10 minutes, and 11 mobility features were extracted from location data for the 2 weeks prior to the PHQ-8 assessment. Dynamic structural equation modeling was used to explore the longitudinal relationships between depressive symptom severity and phone-measured mobility. Results: This study included 2341 PHQ-8 records and corresponding phone-collected location data from 290 participants (age: median 50.0 IQR 34.0, 59.0) years; of whom 215 (74.1%) were female, and 149 (51.4%) were employed. Significant negative correlations were found between depressive symptom severity and phone-measured mobility, and these correlations were more significant at the within-individual level than the between-individual level. For the direction of relationships over time, Homestay (time at home) (φ=0.09, P=.01), Location Entropy (time distribution on different locations) (φ=−0.04, P=.02), and Residential Location Count (reflecting traveling) (φ=0.05, P=.02) were significantly correlated with the subsequent changes in the PHQ-8 score, while changes in the PHQ-8 score significantly affected (φ=−0.07, P<.001) the subsequent periodicity of mobility. Conclusions: Several phone-derived mobility features have the potential to predict future depression, which may provide support for future clinical applications, relapse prevention, and remote mental health monitoring practices in real-world settings